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Integrate,  Enhance,  Demonstrate 
360  LSA/ Assist-Mob/Soldier  Monitor  &  State 
to  Maximize  Soldier-System 
360  LSA  and  Mobility  Capabilities 
Integration  Platform  (Secure  Mobility) 

With  iv  System  Schedule  &  Cost 


360/90  Day/Night 
Near-field  Sensor  Coverage 


Soldier  Monitoring 
&  State 


Aavancea 
Crew  Stations 


Purpose 

Enable  indirect  vision  (IV)  based  Soldier-systems 
(manned/unmanned/Soldier)  to  move  quickly  and  safely  while 
maintaining  360  local  situational  awareness  (LSA)  to  enhance 
operational  performance. 

Product 

•  Advanced  Crew  Stations  integrated  with  360/90  Day/Night  LSA, 
Assisted  Mobility,  and  Soldier  Monitoring  /  State  technologies  to 
improve  Soldier  performance 

•  Quantitative  understanding  (performance  levels)  of  future  indirect 
vision  operations  for  the  movement  and  security  of  Soldier- 
systems  at  a  platoon  and  below  level  when  utilizing: 

•  Assisted  mobility 

•  LSA  system  with  aided  target  cueing 

•  Digital  video  recording  of  360/90  with  intelligent  tagging 


MILESTONES 

M&S  and  Field  Experiments 
Local  360  SA 

-  Task  Analysis 

-  Integrate  Detection  Algorithms 

-  Integrate  Digital  Recording 

-  Integrate  Dismount  System 
Improved  Mobility 

-  Soldier  Task  Balancing 

-  Assisted  Mobility 

Solider  Monitor/State  CS  System 

-  Sensor  Integration 

-  Algorithm  Integration 

-  Integration  Technique 


Total 


TARDEC 

NVESD 

ARL-HRED 

NSRDEC 


•  Soldier  monitoring  and  state  based  crew  station  (CS)  design 

Payoff 

•  Improvement  in  Vehicle  &  Soldier  Survivability,  Vehicle 
Lethality/Self-Defense  &  Control  along  with  Greater 
Survivability/Lethality  for  Dismount  Soldiers 

•  Two  Mounted  Soldier  ability  to  maintain  360  LSA  with  IV 

•  One  Mounted  Soldier  ability  to  move  vehicle  (manned  or 
unmanned)  quickly  and  safely  with  IV 

•  Data  and  Information  to  feed  programmatic  decisions 

•  Risk  reduction  for  FCS 
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RBEGOMJP  Development  Plan  and  Progression 


UNCLASSIFIED 


Integration 
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(TARDEC) 
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Monitor 
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(NSRDEC/ARL 
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TECHNOLOGY  DRIVEN.  WARFIGHTER  FOCUSED. 


RDEGOM 


Partners  /  Responsibilities 
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Tnnoizi 


11311 


TARDEC 

•  Develop  Enhanced  Indirect  Vision  Drive  /  Tele-operation  Systems 

•  Develop  Assisted  Autonomy  Systems 

•  Develop  Warfighter  Machine  Interfaces 

•  Integrate  and  Evaluate 

•  Vehicle  LSA  Systems  (NVESD) 

•  Soldier  Monitoring  &  State  Classification  Systems  (NSRDEC/ARL-HRED) 

•  Assisted  Mobility  (Other  TARDEC  Programs) 

•  Dismount  LSA  Systems  (NSRDEC) 

•  Perform  SIL  and  Vehicle/Field  Experiments 

ARL-HRED 

•  Define  and  Develop  Experimentation  Plans 

•  Work  with  TARDEC  on  Indirect  Vision  Drive  and  Assisted  Autonomy  Systems 

•  Provide  HFE  Support  for  Systems  Development  and  Integration 

•  Develop  Information  Flow  Requirements  and  Algorithms  for  Mobility  and  LSA 

•  Work  with  NSRDEC  on  Soldier  Monitoring  and  Workload  Management  Systems 


NVESD 

•  Enhance  DAS  Sensor  Systems  /  Threat  Detection  Algorithms 

•  Pop-Up  Targeting  and  Gun-Fire  Detection  (before/during/after  shot) 

•  Develop  Digital  Vehicle  LSA  Recording  and  Cueing  System 


NSRDEC 

•  Enhance  and  Transition  Mid-Maturity  Dismount  Soldier  Monitoring  Systems  from 
Augmented  Cognition  Program 

•  Develop/Enhance  Low-Maturity  Soldier  Monitoring  System 

•  Work  with  ARL-HRED  on  Soldier  Monitoring  Systems 

•  Develop  Dismount  LSA  System 
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Urban  Engineering  Evaluation 
Test  Scenario 
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Tnna 


UGV  Recons 
Intersection. 


T0  -  Start  Movement 
T0  /  -  Convoy 

T-,  /  T2  —  Increased  Vigilance 
T3  -  ICV  Processes  SA  from  UAV 
at  Dismount  Location 
T4/  T5  -  Difficult  Urban  Terrain 
T6  -  UGV  Begins  Recon/ICV  Processes  SA  from  UGV 
at  Dismount  Location 

T 7  -  ICV  Dismounts  T roops/T roops  clear  building 
T8  -  ICV  Remounts  Troops/  UGV  and  MGV  debark  / 
T9  -  End  of  Mission 


Suspected  enemy  activity. 
Look  for 


Squad  disrfioqnts 
o  clear  building:  -,.. 


Robotic  Aerial  Vehicle  Route 
Robotic  Ground  Vehicle  Route 
Manned  Vehicle  Route 
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Evolution  of  TARDEC’s  Intelligent 
Ground  Systems  Programs 
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Associate 
Baseline  SMI 
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Field  Experiment  Warfighter  Experiment  Fort  Bliss 


'  Near  Autonomous 
Unmanned  Systems  ATO 


Safe  Unmanned 
Operations  in  Urban 
^Environments 


CAT  and  RF  ATDs 
RDECOM-dAMBL  Experiment 


Robotics 

Collaboration  ATO 


Improved  Mobility  & 
Operational 
Performance  through 
Autonomous 
^Technologies 
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WARFIGHTER  FOG 


”  Testbed  Platforms 
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Manned  Platform  Unmanned  Platforms 


Crew-integration  and  Automation  Testbed 

(CAT) 


gMAV 
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RDEcmvT^  CAT  Crewstations 
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Mission  Module  Workstation 


Warfighter  Machine  Interfaces 
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Modeling  and  Simulation 
System  Integration  Labs 
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Motion  Based  Simulation 
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I  I  =  Video  Equipment 

I  I  =  Shuttle  PC 

I - 1  =  cPCI  SBC 

=  Network 
I — l  =  Other 


-  =  Video 

-  =  TCP/IP 

-  =  USB 

5a  =  Wireless 


WMI  =  Warfighter  Machine  Interface  MESS  =  Master  Embedded  Simulation  System 

MMWS  =  Mission  Module  Workstation  ICS  =  Integrated  Computer  System 

ISBS  =  Intelligent  System  Behavior  Simulator  VTI  =  Vetronics  Technology  Integration 
DSS  =  Decision  Support  System  ANS  =  Autonomous  Navigation  System 

ESS  =  Embedded  Simulation  System  VMS  =  Vehicle  Management  System 
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WMI 


Data  Store 
Services 


Technology  Feeder 
SW  Service  Architecture 
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Technology  Feeders 
Mobility  Autonomy 
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Automation 


Teleop 

Semi- 

Teleop 

Semi- 

Autonomous 

Autonomous 

(Manual) 

(Autonomy 

assisting 

operator) 

(Operator 

Assisting 

autonomy) 

(No  operator 
control) 

Focus:  Reduce  operator  intervention  time  and  workload  through: 

•  Increased  SA/SU 

•  Technology  Integration 

•  Advanced  WMI 

•  Leverage  as  much  as  possible  from  FCS  to  support  RC  objectives 
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Technology  Feeders 
Mobility  Autonomy 


UNCLASSIF 


HMD 


FY  07  (RC  ATOt 

•  Bias 

•  Speed  Adjust 

•  Obstacle  Overlays 

•  Apriori  Overlays 


FY  08  (RC  ATOt 

•  Aggressiveness 

•  Steerable  Waypoint 

•  Confidence 

•  Long  Range 

•  Safety  Push  /  Clear  Map 

•  Obstacles  Map  Aid 

•  Wonder  Women 
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RDECOM 


Eye  Tracking  Pilot  Experiment 


UNCLASSIF 


HMD 


2006  Pilot  Experiment  (TARDEC) 

Tracked  participants  eye-movements 
and  performance  in  full  6-DOF  motion 
base  simulator  while  executing 
supervisory  control. 
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Reaction  Time  (s) 


RDFCOM 


RDECOM-UAMBL  Experiment  2006  (RUX06) 
Soldier  Performance/Workload  w/Automations 
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HMD 


Local  Area  360  SA  -  Identification 
Accuracy  and  Response  Time 

2.5, 


MD  AMS  AMF 

Mobility  Condition 


Planning  on  Move  During  Convoy  Ops 


Condition 

Plan  on  Move 

(%) 

Auto-Pilot  25  mph 

49.5 

Auto-Pilot  15  mph 

54.0 

Indirect  Vision 
Manual  15  mph 

18.0 

Indirect  Vision 
Manual 
15  mph 


Auto-Pilot 
15  mph 


Auto-Pilot 
25  mph 
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